Methods and Tools for the Development of Effective Training Games

BBN has developed several successful game-based training systems for the military. From these and other development efforts, we have identified a number of capability gaps in current methods and tools for developing effective game-based training applications. Our observations and conclusions are drawn from research studies and reviews of games and game-based training systems, as well as from our own experience in developing and fielding several such systems. We discuss lessons learned and additional enhancements in current methods and tools needed to advance the instructional utility and power of gamebased training technology. Motivation There is little doubt that new and emerging technologies will have an impact on how instructional systems are developed and deployed over the next several decades. In this regard, the area of educational games is receiving growing attention due to the perceived motivational power of video and computer games produced for entertainment. Modern computer gaming technology has created highly entertaining games that provide immersive simulation environments enabling rich interactions among distributed players and facilitating the development of strategic thinking and decision-making skills. Studies of the effectiveness of game-based training have been conducted for a variety of domains from single-player scenarios to those involving large teams. These studies confirm that game-based technology shows great promise for delivering compelling experiential training and for effective assessment of cognitive skills, particularly in stressful situations that call for timely judgment and decision-making. Games have promise for evaluating the impact of psychological traits on leadership, for evaluating the ability of a sailor or marine to adapt to new operating conditions and protocols, and for evaluating the ability of combat units to follow new rules of engagement using new equipment in a hostile environment. However, without the necessary research base to inform instructional design and to guide the development of appropriate training and assessment methods and tools, sizeable investments will likely be made on game-based training systems that are ineffective or marginal. Systematic research is needed for guiding the design, development, and effective use of games that have serious educational goals and for demonstrating their effectiveness in facilitating learning. We review the current state of the art, identify capability gaps and present some thoughts on how to address those gaps. These represent our initial efforts under an ONR-sponsored project, “Tools for Game-Based Training and Assessment of Human Performance”, dedicated to the development of the learning science, instructional methods, and technological tools to respond to these challenges.